Speech recognition method and speech recognition apparatus

ABSTRACT

A speech recognition method in a system is provided that controls one or more devices by using speech recognition. The method includes obtaining speech information representing speech spoken by a user, and determining whether the speech is spoken to the one or more devices. The method also includes generating, in a case where it is determined that the speech is spoken to the one or more devices, an operation instruction for the one or more devices. The determining whether the speech is spoken to the one or more devices includes analyzing a sentence pattern of the character information, determining, in a case where the sentence pattern is interrogative or imperative, that the speech is spoken to the one or more devices, and determining, in a case where the sentence pattern is declarative or exclamatory, that the speech is not spoken to the one or more devices.

This is a continuation of U.S. Pending application Ser. No. 14/428,093,filed Mar. 13, 2015, which is a National Stage Application ofPCT/JP2014/003608, filed Jul. 8, 2014, which claims the benefit of U.S.Provisional Application No. 61/973,411, filed Apr. 1, 2014 and U.S.Provisional Application No. 61/871,625, filed Aug. 29, 2013. Thedisclosure of each of these documents including the specification,drawings and claims, are incorporated herein by reference in theirentirety.

TECHNICAL FIELD

The present disclosure relates to a speech recognition method and aspeech recognition apparatus that recognize input speech and control adevice on the basis of the recognition result.

BACKGROUND ART

In a conventional speech recognition apparatus, when a speaker speaks tothe speech recognition apparatus, it has been necessary to give thespeech recognition apparatus a trigger for starting speech recognition.Triggers for speech recognition in conventional speech recognitionapparatuses include pressing of a press-button switch, and detection ofa pre-registered specific keyword (for example, see PTL 1 and 2).

CITATION LIST Patent Literature

PTL 1: Japanese Unexamined Patent Application Publication No.2001-154694

PTL 2: Japanese Unexamined Patent Application Publication No.2006-215499

SUMMARY OF INVENTION Technical Problem

In the above-mentioned conventional speech recognition apparatuses,further improvements have been necessary.

Solution to Problem

A speech recognition method according to an aspect of the presentdisclosure is a speech recognition method in a system that controls oneor more devices by using speech recognition, including: a speechinformation obtaining step of obtaining speech information representingspeech spoken by a user; a speech recognition step of recognizing thespeech information, obtained in the speech information obtaining step,as character information; and a speaking determination step ofdetermining, based on the character information recognized in the speechrecognition step, whether the speech is spoken to the device(s).

Advantageous Effects of Invention

According to the present disclosure, further improvements of speechrecognition can be achieved.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating the configuration of a speechrecognition system according to a first embodiment of the presentdisclosure.

FIG. 2 is a block diagram illustrating the configuration of a deviceaccording to the first embodiment of the present disclosure.

FIG. 3 is a block diagram illustrating the configuration of a speechrecognition apparatus according to the first embodiment of the presentdisclosure.

FIG. 4 is a flowchart for describing the operation of the speechrecognition system according to the first embodiment of the presentdisclosure.

FIG. 5A is a diagram illustrating an example of character informationwhose sentence pattern is declarative. FIG. 5B is a diagram illustratingan example of character information whose sentence pattern isinterrogative. FIG. 5C is a diagram illustrating an example of characterinformation whose sentence pattern is imperative. FIG. 5D is a diagramillustrating an example of character information whose sentence patternis imperative. FIG. 5E is a diagram illustrating an example of characterinformation whose sentence pattern is the pattern that ends with a nounor noun phrase.

FIG. 6 is a diagram illustrating an example of an operation tableaccording to the first embodiment.

FIG. 7 is a diagram illustrating an example of a database regardingweather according to the first embodiment.

FIG. 8 is a block diagram illustrating the configuration of a speechrecognition apparatus according to a second embodiment of the presentdisclosure.

FIG. 9 is a block diagram illustrating the configuration of a speechrecognition apparatus according to a third embodiment of the presentdisclosure.

FIG. 10 is a block diagram illustrating the configuration of a speechrecognition apparatus according to a fourth embodiment of the presentdisclosure.

FIG. 11 is a block diagram illustrating the configuration of a speechrecognition apparatus according to a fifth embodiment of the presentdisclosure.

FIG. 12 is a block diagram illustrating the configuration of a speechrecognition apparatus according to a sixth embodiment of the presentdisclosure.

FIG. 13 is a block diagram illustrating the configuration of a speechrecognition apparatus according to a seventh embodiment of the presentdisclosure.

FIG. 14 is a block diagram illustrating the configuration of aconventional speech recognition apparatus described in PTL 1.

FIG. 15 is a block diagram illustrating the configuration of aconventional speech recognition apparatus described in PTL 2.

DESCRIPTION OF EMBODIMENTS

(Findings that Form Basis of the Present Disclosure)

FIG. 14 is a block diagram illustrating the configuration of aconventional speech recognition apparatus described in PTL 1, and FIG.15 is a block diagram illustrating the configuration of a conventionalspeech recognition apparatus described in PTL 2.

Referring to FIG. 14, a conventional speech recognition apparatus 201includes a speech input section 210 for receiving a speech input, acontroller 220 that detects a command from the speech input received bythe speech input section 210 and controls a device on the basis of thedetected command, and a permitter 230 that detects a certain keywordfrom the speech input received by the speech input section 210 andvalidates control of the device by the controller 220 for a certaincommand input period after the detection of the keyword.

As has been described above, according to PTL 1, since a keyword isreceived as a speech input, it is not necessary to operate a button orthe like whenever the device is controlled. Therefore, a user cancontrol the device even when the user is unable to press the button.

Referring to FIG. 15, a conventional speech recognition apparatus 301includes a speech/non-speech determiner 305 that determines whether asound input from a speech input section 303 is speech or non-speech, akeyword dictionary 310, a speech recognition dictionary 313, a speechrecognizer 308 that performs speech recognition based on the speechrecognition dictionary 313, a speech keyword detector 311 that detectswhether a sound determined to be speech by the speech/non-speechdeterminer 305 is a word registered in advance in the keyword dictionary310, and a recognition instructor 309 that outputs to the speechrecognizer 308 an instruction to perform speech recognition of a soundinput from the speech input section 303 at the time of detection thatthe sound input includes a word registered in the keyword dictionary310. Accordingly, speech recognition is performed in response to thetrigger that is speaking of a specific keyword after an intended commandword is spoken by a user. The speech recognition apparatus 301 of PTL 2is different from that of PTL 1 in that the speech recognition apparatus301 can give a trigger for starting speech recognition without speakingof a pre-registered specific keyword before a command word is spoken.

However, the configuration of the speech recognition apparatus of PTL 1has a problem that speaking a specific keyword for starting speechrecognition is necessary before an intended command word. In addition,the configuration of the speech recognition apparatus of PTL 2 has aproblem that speaking a specific keyword for starting speech recognitionis necessary after an intended command word. In short, speechrecognition will not be started unless a user speaks a specific keywordin either of the speech recognition apparatuses of PTL 1 and PTL 2.

It is conceivable to hide the sense of being a keyword by allowing acommand word to also serve as a keyword for starting speech recognition.However, in this case, there is no change in the point that it is stillnecessary for the contents of speech to always include a keyword, andthe speaker is required to speak while paying attention to a keyword.

From the above observations, the inventors have conceived aspects of thepresent disclosure.

Hereinafter, embodiments of the present disclosure will be describedwith reference to the drawings. Note that the following embodiments areonly examples that embody the present disclosure and are not to beconstrued to limit the technical scope of the present disclosure.

(First Embodiment)

FIG. 1 is a block diagram illustrating the configuration of a speechrecognition system according to a first embodiment of the presentdisclosure. The speech recognition system illustrated in FIG. 1 includesdevices 1 and a server 2.

The devices 1 include home appliances located at home, for example. Thedevices 1 are connected to be communicable with the server 2 via anetwork 3. The network 3 is the Internet, for example.

Note that the devices 1 include a device that is capable ofcommunicating with the network 3 (such as a smart phone, a personalcomputer, or a television) and a device that is not capable ofcommunicating with the network 3 by itself (such as a lighting device, awashing machine, or a refrigerator). There may be a device that isincapable of communicating with the network 3 by itself but is capableof communicating with the network 3 via a home gateway. A device that iscapable of communicating with the network 3 may be connected directly tothe server 2, instead of using a home gateway.

The server 2 includes a conventional server computer, for example, andis connected to be communicable with the devices 1 via the network 3.

FIG. 2 is a block diagram illustrating the configuration of each of thedevices 1 according to the first embodiment of the present disclosure.The device 1 according to the first embodiment includes a communicator11, a controller 12, a memory 13, a microphone 14, a loudspeaker 15, adisplay 16, and a speech recognition apparatus 100. Note that the device1 may not necessarily include some of these elements or may includeother elements.

The communicator 11 transmits information to the server 2 via thenetwork 3 and receives information from the server 2 via the network 3.The controller 12 includes a CPU (central processing unit), for example,and controls the entire device 1.

The memory 13 includes a ROM (read-only memory) or a RAM (random-accessmemory), for example, and stores information. The microphone 14 convertsspeech to an electric signal and outputs the electric signal as speechinformation. The microphone 14 includes a microphone array including atleast three microphones and collects sound in a space where the device 1is located. The loudspeaker 15 outputs sound. The display 16 includes anLCD (liquid crystal display), for example, and displays various types ofinformation.

The speech recognition apparatus 100 recognizes a user's speech andgenerates an operation instruction for causing the device 1 to operate.The controller 12 causes the device 1 to operate on the basis of anoperation instruction in accordance with speech recognized by the speechrecognition apparatus 100.

FIG. 3 is a block diagram illustrating the configuration of a speechrecognition apparatus according to the first embodiment of the presentdisclosure.

As illustrated in FIG. 3, the speech recognition apparatus 100 accordingto the first embodiment includes a speech obtainer 101, a speechrecognition processor 102, a recognition result determiner 103, and anoperation instruction generator 104.

The speech obtainer 101 obtains speech information representing speechspoken by a user. The speech obtainer 101 obtains speech informationfrom the microphone 14. Specifically, the microphone 14 converts speech,which is an analog signal, to speech information, which is digitalsignal, and the speech obtainer 101 obtains the speech information,which has been converted to a digital signal, from the microphone 14.The speech obtainer 101 outputs the obtained speech information to thespeech recognition processor 102.

The speech recognition processor 102 recognizes the speech information,obtained by the speech obtainer 101, as character information. Thespeech recognition processor 102 receives the speech information fromthe speech obtainer 101, performs speech recognition using a speechrecognition dictionary, and outputs character information as a speechrecognition result.

The recognition result determiner 103 determines, on the basis of thecharacter information recognized by the speech recognition processor102, whether the speech is spoken to the device 1. The recognitionresult determiner 103 analyzes the speech recognition result receivedfrom the speech recognition processor 102, and generates a recognitionresult parse tree corresponding to the speech recognition result. Therecognition result determiner 103 analyzes the generated recognitionresult parse tree, and estimates the sentence pattern of the characterinformation recognized by the speech recognition processor 102.

The recognition result determiner 103 analyzes the sentence pattern ofthe character information, determines whether the sentence pattern isinterrogative or imperative, and, in the case where the sentence patternis interrogative or imperative, determines that the speech is spoken tothe device 1. In contrast, in the case where the sentence pattern is notinterrogative or imperative, that is, in the case where the sentencepattern is declarative or exclamatory, the recognition result determiner103 determines that the speech is not spoken to the device 1.

In the case where it is determined by the recognition result determiner103 that the speech is spoken to the device 1, the operation instructiongenerator 104 generates an operation instruction for the device 1. Onthe basis of the determination result received from the recognitionresult determiner 103, the operation instruction generator 104determines the device to which an operation instruction is to be sentand the operation contents, and generates an operation instructionincluding the determined operation contents for the determined device.

Here, the operation of the speech recognition system according to thefirst embodiment of the present disclosure will be described. FIG. 4 isa flowchart for describing the operation of the speech recognitionsystem according to the first embodiment of the present disclosure.

First in step S1, the speech obtainer 101 obtains speech informationfrom the microphone 14 provided on the device 1.

Next in step S2, the speech recognition processor 102 recognizes thespeech information, obtained by the speech obtainer 101, as characterinformation.

Next in step S3, the recognition result determiner 103 determines, onthe basis of the character information recognized by the speechrecognition processor 102, whether the speech is spoken to the device 1.

More specifically, the recognition result determiner 103 analyzes thesyntax of the character information, recognized by the speechrecognition processor 102, by using an existing syntax analysistechnique. As the syntax analysis technique, for example, the analysissystem indicated by URL:http://nlp.ist.i.kyoto-u.ac.jp/index.php?KNP canbe used. The recognition result determiner 103 divides each sentence ofthe character information into a plurality of phrases, analyzes the partof speech of each phrase, and analyzes the conjugated form of each partof speech (declinable word or phrase). There are certain sentencepatterns. Thus, the recognition result determiner 103 analyzes thesentence pattern of character information and determines whether thesentence pattern is one of declarative, interrogative, exclamatory, andimperative. In the case where the sentence pattern is eitherinterrogative or imperative, the recognition result determiner 103determines that the speech is spoken to the device 1. In the case wherethe sentence includes an interrogative word, for example, therecognition result determiner 103 is able to determine that the sentencepattern of the character information is interrogative. In addition, inthe case where the conjugated form of a word at the end of the sentenceis imperative, for example, the recognition result determiner 103 isable to determine that the sentence pattern of the character informationis imperative.

In the case where it is determined in step S3 that the speech is notspoken to the device 1 (NO in step S3), the process returns toprocessing in step S1.

In contrast, in the case where it is determined in step S3 that thespeech is spoken to the device 1 (YES in step S3), the operationinstruction generator 104 generates, in step S4, an operationinstruction for the device 1. The operation instruction generator 104stores in advance an operation table where a combination of multiplewords and a device operation are associated with each other. Note thatthe operation table will be described later. In the case where it isdetermined in step S3 that the speech is spoken to the device 1, theoperation instruction generator 104 refers to the operation table,specifies a device operation corresponding to a combination of wordsincluded in the character information analyzed by the recognition resultdeterminer 103, and generates an operation instruction for causing thedevice to perform the specified operation.

An example in which an inquiry about the weather forecast is made usingthe speech recognition apparatus with the above-described configurationwill be described.

FIG. 5A is a diagram illustrating an example of character informationwhose sentence pattern is declarative. FIG. 5B is a diagram illustratingan example of character information whose sentence pattern isinterrogative. FIG. 5C is a diagram illustrating an example of characterinformation whose sentence pattern is imperative. FIG. 5D is a diagramillustrating an example of character information whose sentence patternis imperative. FIG. 5E is a diagram illustrating an example of characterinformation whose sentence pattern is the pattern that ends a sentencewith a noun or noun phrase.

Referring to FIG. 5A, when the speech obtainer 101 obtains the speechinformation “Ashitano tenkiwa hareda (Tomorrow's weather will besunny)”, the speech recognition processor 102 converts the speechinformation to the character information “Ashitano tenkiwa hareda(Tomorrow's weather will be sunny)”. The speech recognition processor102 outputs the recognized character information as a speech recognitionresult to the recognition result determiner 103.

The recognition result determiner 103 divides the character informationrecognized by the speech recognition processor 102 into the phrases“Ashitano (tomorrow's)”, “tenkiwa (weather will be)”, “hareda (sunny)”,analyzes whether each phrase is indeclinable or declinable, and, if thephrase is declinable, analyzes the part of speech of a word included inthat phrase. Referring to FIG. 5A, since the phrase at the end of thesentence is a copula, the recognition result determiner 103 determinesthat the sentence pattern of the character information is declarative.In the case where the recognition result determiner 103 determines thatthe sentence pattern is declarative, the recognition result determiner103 determines that the speech is not spoken to the device 1.

In addition, referring to FIG. 5B, when the speech obtainer 101 obtainsthe speech information “Ashitano tenkiwa doudesuka (How is the weathertomorrow?)”, the speech recognition processor 102 converts the speechinformation to the character information “Ashitano tenkiwa doudesuka(How is the weather tomorrow?)”. The speech recognition processor 102outputs the recognized character information as a speech recognitionresult to the recognition result determiner 103.

The recognition result determiner 103 divides the character informationrecognized by the speech recognition processor 102 into the phrases“Ashitano (tomorrow's)”, “tenkiwa (weather)”, “doudesuka (how is)”,analyzes whether each phrase is indeclinable or declinable, and, if thephrase is declinable, analyzes the part of speech of a word included inthat phrase. Referring to FIG. 5B, since the phrase at the end of thesentence includes an interrogative word, the recognition resultdeterminer 103 determines that the sentence pattern of the characterinformation is interrogative. In the case where the recognition resultdeterminer 103 determines that the sentence pattern is interrogative,the recognition result determiner 103 determines that the speech isspoken to the device 1.

In the case where it is determined that the speech is spoken to thedevice 1, the operation instruction generator 104 refers to theoperation table and generates an operation instruction for the device 1.FIG. 6 is a diagram illustrating an example of the operation tableaccording to the first embodiment. In an operation table 1401, forexample, as illustrated in FIG. 6, a word 1 that is a word string fordetermining date and time, a word 2 that is a word string fordetermining an operation purpose or a search target, and a word 3 thatis a word string for determining whether the speech is spoken to thesystem are linked with one another.

In the example illustrated in FIG. 5B, the operation instructiongenerator 104 determines, by using the operation table 1401, theoperation “output: weather [one day later]” from the word 1 “tomorrow”,which represents date and time, the word 2 “weather”, which represents asearch target, and the word 3 “how”, which represents that the speech isspoken to the system.

The operation instruction generator 104 outputs an operationinstruction, to the controller 12 of the device 1, for obtaining theweather forecast for the next day from a server that provides weatherforecasts. On the basis of the operation instruction from the operationinstruction generator 104, the controller 12 accesses the server, whichprovides weather forecasts, obtains the weather forecast for the nextday from a database regarding weather in the server, and outputs theobtained weather forecast from the display 16 or the loudspeaker 15.FIG. 7 is a diagram illustrating an example of a database regardingweather according to the first embodiment. In a database 1402 regardingweather, for example, as illustrated in FIG. 7, date and weather arelinked with each other. Note that, in this case, the controller 12transmits to the server, which provides weather forecasts, positioninformation for specifying the current position of the device 1, therebyenabling obtaining of the weather forecast at the current position.

Next, referring to FIG. 5C, when the speech obtainer 101 obtains thespeech information “Ashitano tenkiwo oshiete (Tell me tomorrow'sweather), the speech recognition processor 102 converts the speechinformation to the character information “Ashitano tenkiwo oshiete (Tellme tomorrow's weather)”. The speech recognition processor 102 outputsthe recognized character information as a speech recognition result tothe recognition result determiner 103.

The recognition result determiner 103 divides the character informationrecognized by the speech recognition processor 102 into the phrases“Ashitano (tomorrow's)”, “tenkiwo (weather)”, “oshiete (tell me)”,analyzes whether each phrase is indeclinable or declinable, and, if thephrase is declinable, analyzes the part of speech of a word included inthat phrase. Referring to FIG. 5C, since the conjugated form of a wordat the end of the sentence is imperative, the recognition resultdeterminer 103 determines that the sentence pattern of the characterinformation is imperative. In the case where the recognition resultdeterminer 103 determines that the sentence pattern is imperative, therecognition result determiner 103 determines that the speech is spokento the device 1.

In the case where it is determined that the speech is spoken to thedevice 1, the operation instruction generator 104 generates an operationinstruction for the device 1. In the example illustrated in FIG. 5C, theoperation instruction generator 104 determines, by using the operationtable 1401, the operation “output: weather [one day later]” from theword 1 “tomorrow”, which represents date and time, the word 2 “weather”,which represents a search target, and the word 3 “tell”, whichrepresents that the speech is spoken to the system.

The operation instruction generator 104 outputs an operationinstruction, to the controller 12 of the device 1, for obtaining theweather forecast for the next day from the database 1402 regardingweather in the server, which provides weather forecasts. The operationof the controller 12 hereinafter is the same as that described above.

Next, referring to FIG. 5D, when the speech obtainer 101 obtains thespeech information “Asatteno tenkiwo shirabete (Check the weather forthe day after tomorrow)”, the speech recognition processor 102 convertsthe speech information to the character information “Asatteno tenkiwoshirabete (Check the weather for the day after tomorrow)”. The speechrecognition processor 102 outputs the recognized character informationas a speech recognition result to the recognition result determiner 103.

The recognition result determiner 103 divides the character informationrecognized by the speech recognition processor 102 into the phrases“Asatteno (for the day after tomorrow)”, “tenkiwo (weather)”, “shirabete(check)”, analyzes whether each phrase is indeclinable or declinable,and, if the phrase is declinable, analyzes the part of speech of a wordincluded in that phrase. Referring to FIG. 5D, since the conjugated formof a word at the end of the sentence is imperative, the recognitionresult determiner 103 determines that the sentence pattern of thecharacter information is imperative. In the case where the recognitionresult determiner 103 determines that the sentence pattern isimperative, the recognition result determiner 103 determines that thespeech is spoken to the device 1.

In the case where it is determined that the speech is spoken to thedevice 1, the operation instruction generator 104 generates an operationinstruction for the device 1. In the example illustrated in FIG. 5D, theoperation instruction generator 104 determines, by using the operationtable 1401, the operation “output: weather [two days later]” from theword 1 “day after tomorrow”, which represents date and time, the word 2“weather”, which represents a search target, and the word 3 “check”,which represents that the speech is spoken to the system.

The operation instruction generator 104 outputs an operationinstruction, to the controller 12 of the device 1, for obtaining theweather forecast for the next day from the database 1402 regardingweather in the server, which provides weather forecasts. The operationof the controller 12 hereinafter is the same as that described above.

Next, referring to FIG. 5E when the speech obtainer 101 obtains thespeech information “Ashitano tenki (The weather tomorrow)”, the speechrecognition processor 102 converts the speech information to thecharacter information “Ashitano tenki (The weather tomorrow)”. Thespeech recognition processor 102 outputs the recognized characterinformation as a speech recognition result to the recognition resultdeterminer 103.

The recognition result determiner 103 divides the character informationrecognized by the speech recognition processor 102 into the phrases“Ashitano (for tomorrow)” and “tenki (weather)”, analyzes whether eachphrase is indeclinable or declinable, and, if the phrase is declinable,analyzes the part of speech of a word included in that phrase. Referringto FIG. 5E, since the word at the end of the sentence is indeclinable,the recognition result determiner 103 determines that the sentencepattern of the character information is the pattern that ends a sentencewith a noun or noun phrase. In the case where the recognition resultdeterminer 103 determines that the sentence pattern is the pattern thatends a sentence with a noun or noun phrase, the recognition resultdeterminer 103 determines that the speech is spoken to the device 1.

In the case where it is determined that the speech is spoken to thedevice 1, the operation instruction generator 104 generates an operationinstruction for the device 1. For example, in the operation table, acombination of the words “tomorrow” and “weather” and the operation toobtain a weather forecast are associated with each other. Therefore, theoperation instruction generator 104 refers to the operation table,specifies the device operation to obtain a weather forecast,corresponding to a combination of the words “tomorrow” and “weather”included in the character information analyzed by the recognition resultdeterminer 103, and generates an operation instruction for causing thedevice 1 to perform the specified operation.

The operation instruction generator 104 outputs the operationinstruction, to the controller 12 of the device 1, for obtaining theweather forecast for the next day from the server, which providesweather forecasts. The operation of the controller 12 hereinafter is thesame as that described above.

According to the above configuration, in the case where it is determinedby the recognition result determiner 103 that the speech is spoken tothe device 1, the operation instruction generator 104 generates anoperation instruction for the device 1; and, in the case where it isdetermined by the recognition result determiner 103 that the speech isnot spoken to the device 1, no operation instruction for the device 1 isgenerated. Thus, speaking a specific keyword that serves as a triggerfor starting speech recognition becomes unnecessary. Therefore, the usercan speak without paying attention to a specific keyword that serves asa trigger for starting speech recognition, and the user can operate thedevice using daily conversation.

Although the device 1 includes the speech recognition apparatus 100 inthe present embodiment, the present disclosure is not limited thereto,and the server 2 may include the speech recognition apparatus 100. Inthis case, speech information obtained by the microphone 14 of thedevice 1 is transmitted to the server 2 via the network 3, and thespeech recognition apparatus 100 of the server 2 executes processing insteps S1 to S4 of FIG. 4. In the case where it is determined that thespeech is spoken to the device, the server 2 transmits an operationinstruction for the device 1 on the basis of the speech recognitionprocessing result, and the device 1 operates in accordance with theoperation instruction from the server 2. This is applicable to otherembodiments.

In addition, each functional block of the speech recognition apparatus100 according to the present embodiment may be realized by amicroprocessor operating in accordance with a computer program. Inaddition, each functional block of the speech recognition apparatus 100may be realized as an LSI (large Scale Integration) which is typicallyan integrated circuit. Each functional block of the speech recognitionapparatus 100 may be individually configured as a chip, or one or morefunctional blocks or some of the functional blocks may be configured asa chip. Further, each functional block of the speech recognitionapparatus 100 may be realized by software or a combination of an LSI andsoftware.

(Second Embodiment)

Next, a speech recognition apparatus according to a second embodimentwill be described. The speech recognition apparatus according to thesecond embodiment measures a silent time and determines whether speechis spoken to the device 1 in accordance with the length of the measuredsilent time.

That is, in the case of detection of a user's speech after a silentstate that lasts for a certain time or longer, it is highly likely thatthe user is speaking to the device (operation command). Therefore, inthe second embodiment, the speech recognition apparatus measures asilent time from when obtaining of speech information is completed towhen obtaining of the next speech information is started, and, in thecase where the measured silent time is greater than or equal to acertain time, determines that the speech is spoken to the device 1.

FIG. 8 is a block diagram illustrating the configuration of the speechrecognition apparatus according to the second embodiment of the presentdisclosure. Since the configuration of a speech recognition systemaccording to the second embodiment is the same as the configuration ofthe speech recognition system according to the first embodiment, adescription thereof is omitted. In addition, since the configuration ofa device according to the second embodiment is the same as theconfiguration of the device 1 according to the first embodiment, adescription thereof is omitted.

The speech recognition apparatus 100 according to the second embodimentincludes the speech obtainer 101, the speech recognition processor 102,the operation instruction generator 104, a silent time measurer 105, asilent time determiner 106, and a recognition result determiner 107. Inthe speech recognition apparatus according to the second embodiment, thesame configuration as that of the first embodiment is given the samereference numeral, and a description thereof is omitted.

The silent time measurer 105 measures, as a silent time, a time sinceobtaining of speech information by the speech obtainer 101 is completed.

In the case where speech information is obtained by the speech obtainer101, the silent time determiner 106 determines whether the silent timemeasured by the silent time measurer 105 is greater than or equal to acertain time.

In the case where it is determined that the measured silent time isgreater than or equal to the certain time, the recognition resultdeterminer 107 determines that the speech is spoken to the device 1.

For example, in the case where speech information is obtained by thespeech obtainer 101, the silent time determiner 106 determines whetherthe silent time measured by the silent time measurer 105 is greater thanor equal to a time during which the user had been speaking. In addition,for example, in the case where it is determined that the measured silenttime is greater than or equal to a predetermined certain time, therecognition result determiner 107 may determine that the speech isspoken to the device 1. Here, the predetermined certain time is 30seconds, for example, which is a time based on which it is possible todetermine that the user is not talking to another person.

According to the above configuration, a time since obtaining of speechinformation is completed is measured as a silent time, and, in responseto obtaining of the next speech information, when it is determined thatthe measured silent time is greater than or equal to a certain time, itis determined that the speech is spoken to the device. Thus, the usercan speak without paying attention to a specific keyword that serves asa trigger for starting speech recognition, and the user can operate thedevice using daily conversation.

When the user speaks after a silent time lasts for a certain time orlonger and when a silent time after the user ends speaking is shorterthan the certain time, it is highly likely that the user is talking toanother person. Therefore, when speech information is obtained after asilent time lasts for a certain time or longer and when a silent timelasts for the certain time or longer after obtaining of the speechinformation is completed, the recognition result determiner 107 maydetermine that the speech is spoken to the device 1.

(Third Embodiment)

Next, a speech recognition apparatus according to a third embodimentwill be described. The speech recognition apparatus according to thethird embodiment determines whether a certain keyword regarding theoperation of the device 1 is included in character information, and, inthe case where the certain keyword is included in the characterinformation, determines that the speech is spoken to the device 1.

FIG. 9 is a block diagram illustrating the configuration of the speechrecognition apparatus according to the third embodiment of the presentdisclosure. Since the configuration of a speech recognition systemaccording to the third embodiment is the same as the configuration ofthe speech recognition system according to the first embodiment, adescription thereof is omitted. In addition, since the configuration ofa device according to the third embodiment is the same as theconfiguration of the device 1 according to the first embodiment, adescription thereof is omitted.

The speech recognition apparatus 100 according to the third embodimentincludes the speech obtainer 101, the speech recognition processor 102,the operation instruction generator 104, a keyword memory 108, and arecognition result determiner 109. In the speech recognition apparatusaccording to the third embodiment, the same configuration as that of thefirst embodiment is given the same reference numeral, and a descriptionthereof is omitted.

The keyword memory 108 stores in advance a certain keyword regarding theoperation of the device.

The recognition result determiner 109 determines whether the pre-storedkeyword is included in character information, and, in the case where thekeyword is included in the character information, determines that thespeech is spoken to the device 1.

For example, in the case where the device 1 is a television, the keywordmemory 108 stores in advance the keywords “channel” and “change”. Therecognition result determiner 109 refers to the keyword memory 108 and,in the case where words included in the character information includethe keywords “channel” and “change”, determines that the speech isspoken to the device 1.

In this case, for example, in the operation table, a combination of thewords “channel” and “change” and the operation to change the channel ofthe television are associated with each other. Therefore, the operationinstruction generator 104 refers to the operation table, specifies theoperation to change the channel of the television, corresponding to acombination of the words “channel” and “change” included in thecharacter information analyzed by the recognition result determiner 103,and generates an operation instruction for causing the device 1 toperform the specified operation.

According to the above configuration, whether a certain keywordregarding the operation of the device is included in characterinformation is determined, and, in the case where the certain keyword isincluded in the character information, it is determined that the speechis spoken to the device 1. Thus, the user can speak without payingattention to a specific keyword that serves as a trigger for startingspeech recognition, and the user can operate the device using dailyconversation.

(Fourth Embodiment)

Next, a speech recognition apparatus according to a fourth embodimentwill be described. The speech recognition apparatus according to thefourth embodiment determines whether a pre-stored personal name isincluded in character information, and, in the case where the personalname is included in the character information, determines that thespeech is not spoken to the device 1.

That is, in the case where the user's speech includes a personal name,such as the name of a family member, it is highly likely that the useris talking to a person with that name, and it is highly likely that theuser is not speaking to the device. Therefore, the speech recognitionapparatus according to the fourth embodiment stores in advance apersonal name, such as the name of a family member, and, in the casewhere the pre-stored personal name is included in character information,determines that the speech is not spoken to the device 1.

FIG. 10 is a block diagram illustrating the configuration of the speechrecognition apparatus according to the fourth embodiment of the presentdisclosure. Since the configuration of a speech recognition systemaccording to the fourth embodiment is the same as the configuration ofthe speech recognition system according to the first embodiment, adescription thereof is omitted. In addition, since the configuration ofa device according to the fourth embodiment is the same as theconfiguration of the device according to the first embodiment, adescription thereof is omitted.

The speech recognition apparatus 100 according to the fourth embodimentincludes the speech obtainer 101, the speech recognition processor 102,the operation instruction generator 104, a personal name memory 110, anda recognition result determiner 111. In the speech recognition apparatusaccording to the fourth embodiment, the same configuration as that ofthe first embodiment is given the same reference numeral, and adescription thereof is omitted.

The personal name memory 110 stores in advance a personal name. Here,the personal name memory 110 stores in advance the name of a familymember who lives in a house where the device 1 is located or the name ofa family member of a user who owns the device 1. In addition, thepersonal name memory 110 may store in advance the nickname of a familymember, such as Dad, Mom, or Big Brother. Note that a personal name isinput by the user using an input acceptor (not illustrated) included inthe device 1 and is stored in the personal name memory 110.

The recognition result determiner 111 determines whether a personal nameor a nickname stored in advance in the personal name memory 110 isincluded in character information, and, in the case where the personalname or nickname is included in the character information, determinesthat the speech is not spoken to the device 1. Note that, in the casewhere the name of a family member is stored as user information in theserver 2, the recognition result determiner 111 may performdetermination using the user information stored in the server 2.

In addition, as in the first embodiment, the recognition resultdeterminer 111 analyzes the sentence pattern of character information,determines whether the sentence pattern is interrogative or imperative,and, in the case where the sentence pattern is interrogative orimperative, determines that the speech is spoken to the device 1. Atthis time, even in the case where it is determined that the sentencepattern is interrogative or imperative, if a personal name or a nicknamestored in advance in the personal name memory 110 is included in thecharacter information, the recognition result determiner 111 determinesthat the speech is not spoken to the device 1. That is, in the casewhere it is determined that the sentence pattern is interrogative orimperative and a personal name or a nickname stored in advance in thepersonal name memory 110 is not included in the character information,the recognition result determiner 111 determines that the speech isspoken to the device 1.

According to the above configuration, whether a pre-stored personal nameor nickname is included in character information is determined, and, inthe case where the personal name or nickname is included in thecharacter information, it is determined that the speech is not spoken tothe device 1. Thus, the user can speak without paying attention to aspecific keyword that serves as a trigger for starting speechrecognition, and the user can operate the device using dailyconversation.

(Fifth Embodiment)

Next, a speech recognition apparatus according to a fifth embodimentwill be described. The speech recognition apparatus according to thefifth embodiment detects a person in a space where the device 1 islocated, determines that the speech is not spoken to the device 1 inresponse to detection of a plurality of people, and determines that thespeech is spoken to the device 1 in response to detection of one person.

That is, in the case where there is a plurality of people in a spacewhere the device 1 is located, it is highly likely that the user istalking to another person, and it is highly likely that the user is notspeaking to the device 1. In contrast, in the case where there is onlyone person in a space where the device 1 is located, it is highly likelythat the user is speaking to the device 1. Therefore, in the fifthembodiment, in response to detection of a plurality of people in a spacewhere the device 1 is located, the speech recognition apparatusdetermines that the speech is not spoken to the device 1. In addition,in response to detection of one person in a space where the device 1 islocated, the speech recognition apparatus determines that the speech isspoken to the device 1.

FIG. 11 is a block diagram illustrating the configuration of the speechrecognition apparatus according to the fifth embodiment of the presentdisclosure. Since the configuration of a speech recognition systemaccording to the fifth embodiment is the same as the configuration ofthe speech recognition system according to the first embodiment, adescription thereof is omitted. In addition, since the configuration ofa device according to the fifth embodiment is the same as theconfiguration of the device 1 according to the first embodiment, adescription thereof is omitted.

The speech recognition apparatus 100 according to the fifth embodimentincludes the speech obtainer 101, the speech recognition processor 102,the operation instruction generator 104, a person detector 112, and arecognition result determiner 113. In the speech recognition apparatusaccording to the fifth embodiment, the same configuration as that of thefirst embodiment is given the same reference numeral, and a descriptionthereof is omitted.

The person detector 112 detects a person in a space where the device islocated. Note that the person detector 112 may detect a person byanalyzing an image obtained from a camera included in the device 1.Alternatively, the person detector 112 may detect a person using amotion sensor or a heat sensor.

In response to detection of a plurality of people by the person detector112, the recognition result determiner 113 determines that the speech isnot spoken to the device 1; and, in response to detection of one personby the person detector 112, the recognition result determiner 113determines that the speech is spoken to the device 1.

In addition, as in the first embodiment, the recognition resultdeterminer 113 analyzes the sentence pattern of character information,determines whether the sentence pattern is interrogative or imperative,and, in the case where the sentence pattern is interrogative orimperative, determines that the speech is spoken to the device 1. Atthis time, even in the case where it is determined that the sentencepattern is interrogative or imperative, if a plurality of people isdetected by the person detector 112, the recognition result determiner113 determines that the speech is not spoken to the device 1. That is,in the case where the sentence pattern is interrogative or imperativeand a plurality of people is not detected by the person detector 112(one person is detected), the recognition result determiner 111determines that the speech is spoken to the device 1.

According to the above configuration, it is determined that the speechis not spoken to the device in response to detection of a plurality ofpeople, and it is determined that the speech is spoken to the device inresponse to detection of one person. Thus, the user can speak withoutpaying attention to a specific keyword that serves as a trigger forstarting speech recognition, and the user can operate the device usingdaily conversation.

(Sixth Embodiment)

Next, a speech recognition apparatus according to a sixth embodimentwill be described. The speech recognition apparatus according to thesixth embodiment determines whether the conjugated form of a declinableword or phrase included in character information is imperative, and, inthe case where the conjugated form is imperative, determines that thespeech is spoken to the device 1.

That is, in the case where the conjugated form of a declinable word orphrase included in character information is imperative, it is highlylikely that the user is speaking to the device 1. Therefore, in thesixth embodiment, the speech recognition apparatus determines theconjugated form of a declinable word or phrase included in characterinformation, and, in the case where the conjugated form is imperative,determines that the speech is spoken to the device 1.

FIG. 12 is a block diagram illustrating the configuration of the speechrecognition apparatus according to the sixth embodiment of the presentdisclosure. Since the configuration of a speech recognition systemaccording to the sixth embodiment is the same as the configuration ofthe speech recognition system according to the first embodiment, adescription thereof is omitted. In addition, since the configuration ofa device according to the sixth embodiment is the same as theconfiguration of the device 1 according to the first embodiment, adescription thereof is omitted.

The speech recognition apparatus 100 according to the sixth embodimentincludes the speech obtainer 101, the speech recognition processor 102,the operation instruction generator 104, and a recognition resultdeterminer 114. In the speech recognition apparatus according to thesixth embodiment, the same configuration as that of the first embodimentis given the same reference numeral, and a description thereof isomitted.

The recognition result determiner 114 analyzes whether the conjugatedform of a declinable word or phrase included in character information isone of irrealis, adverbial, conclusive, attributive, realis, andimperative. The recognition result determiner 114 determines whether theconjugated form of a declinable word or phrase included in characterinformation is imperative, and, in the case where the conjugated form isimperative, determines that the speech is spoken to the device 1. Therecognition result determiner 114 divides each sentence of the characterinformation into a plurality of phrases, analyzes the part of speech ofeach phrase, and analyzes the conjugated form of each part of speech(declinable word or phrase). In the case where a phrase whose conjugatedform is imperative is included in the character information, therecognition result determiner 114 determines that the speech is spokento the device 1.

In addition, in the case where the conjugated form is not imperative,that is, in the case where the conjugated form is irrealis, adverbial,conclusive, attributive, or realis, the recognition result determiner114 determines that the speech is not spoken to the device 1.

According to the above configuration, whether the conjugated form of adeclinable word or phrase included in character information isimperative is determined, and, in the case where the conjugated form isimperative, it is determined that the speech is spoken to the device 1.Thus, the user can speak without paying attention to a specific keywordthat serves as a trigger for starting speech recognition, and the usercan operate the device using daily conversation.

Note that the recognition result determiner 114 may determine whetherthe conjugated form of a declinable word or phrase included in characterinformation is conclusive or imperative, and, in the case where theconjugated form is conclusive or imperative, may determine that thespeech is spoken to the device 1.

Note that a speech recognition apparatus according to the presentdisclosure may combine the speech recognition apparatuses according tothe above-described first to sixth embodiments.

(Seventh Embodiment)

Next, a speech recognition apparatus according to a seventh embodimentwill be described. The speech recognition apparatus according to theseventh embodiment adds weight values given in accordance with certaindetermination results for character information, determines whether thesum weight value is greater than or equal to a certain value, and, inthe case where the sum weight value is greater than or equal to thecertain value, determines that the speech is spoken to the device 1.

FIG. 13 is a block diagram illustrating the configuration of the speechrecognition apparatus according to the seventh embodiment of the presentdisclosure. Since the configuration of a speech recognition systemaccording to the seventh embodiment is the same as the configuration ofthe speech recognition system according to the first embodiment, adescription thereof is omitted. In addition, since the configuration ofa device according to the seventh embodiment is the same as theconfiguration of the device 1 according to the first embodiment, adescription thereof is omitted.

The speech recognition apparatus 100 according to the seventh embodimentincludes the speech obtainer 101, the speech recognition processor 102,the operation instruction generator 104, the silent time measurer 105,the silent time determiner 106, the keyword memory 108, the personalname memory 110, the person detector 112, a weight value table memory115, a weight value calculator 116, a recognition result determiner 117,a pitch extractor 118, a pitch memory 119, and a speaker recognizer 120.In the speech recognition apparatus according to the seventh embodiment,the same configuration as that of the first to sixth embodiments isgiven the same reference numeral, and a description thereof is omitted.

The weight value table memory 115 stores a weight value table in which acertain determination result for character information and a weightvalue are associated with each other. In the weight value table, thedetermination result that the sentence pattern of character informationis interrogative or imperative is associated with a first weight value.In addition, in the weight value table, the determination result that asilent time from when obtaining of speech information is completed towhen obtaining of the next speech information is started is greater thanor equal to a certain time is associated with a second weight value. Inaddition, in the weight value table, the determination result that apre-stored keyword is included in character information is associatedwith a third weight value. In addition, in the weight value table, thedetermination result that a pre-stored personal name or nickname isincluded in character information is associated with a fourth weightvalue. In addition, in the weight value table, the determination resultthat a plurality of people is detected is associated with a fifth weightvalue. In addition, in the weight value table, the determination resultthat one person is detected is associated with a sixth weight value. Inaddition, in the weight value table, the determination result that theconjugated form of a declinable word or phrase included in characterinformation is imperative is associated with a seventh weight value. Inaddition, in the weight value table, the pitch frequency of speechinformation is associated with an eighth weight value.

The weight value calculator 116 adds weight values given in accordancewith certain determination results for character information. The weightvalue calculator 116 adds a weight value given in accordance withwhether the sentence pattern of character information is interrogativeor imperative, a weight value given in accordance with whether a silenttime from when obtaining of speech information is completed to whenobtaining of the next speech information is started is greater than orequal to a certain time, a weight value given in accordance with whethera pre-stored certain keyword regarding the operation of the device isincluded in the character information, a weight value given inaccordance with whether a pre-stored personal name is included in thecharacter information, a weight value given in accordance with whether aplurality of people is detected in a space where the device is located,a weight value given in accordance with whether the conjugated form of adeclinable word or phrase included in the character information isimperative, and a weight value given in accordance with whether thepitch frequency of the speech information is greater than or equal to acertain threshold.

The weight value calculator 116 analyzes the sentence pattern ofcharacter information recognized by the speech recognition processor102, determines whether the sentence pattern is interrogative orimperative, and, in the case where the sentence pattern is interrogativeor imperative, reads the corresponding first weight value from theweight value table memory 115.

In addition, in the case where it is determined by the silent timedeterminer 106 that a silent time from when obtaining of speechinformation is completed to obtaining of the next speech information isstarted by the speech obtainer 101 is greater than or equal to a certaintime, the weight value calculator 116 reads the corresponding secondweight value from the weight value table memory 115.

In addition, the weight value calculator 116 determines whether akeyword stored in advance in the keyword memory 108 is included incharacter information recognized by the speech recognition processor102, and, in the case where the keyword is included in the characterinformation, reads the corresponding third weight value from the weightvalue table memory 115.

In addition, the weight value calculator 116 determines whether apersonal name or a nickname stored in advance in the personal namememory 110 is included in character information recognized by the speechrecognition processor 102, and, in the case where the personal name ornickname is included in the character information, reads thecorresponding fourth weight value from the weight value table memory115.

In addition, in the case where a plurality of people is detected by theperson detector 112, the weight value calculator 116 reads thecorresponding fifth weight value from the weight value table memory 115.

In addition, in the case where one person is detected by the persondetector 112, the weight value calculator 116 reads the correspondingsixth weight value from the weight value table memory 115.

In addition, the weight value calculator 116 determines whether theconjugated form of a declinable word or phrase included in characterinformation recognized by the speech recognition processor 102 isimperative, and, in the case where the conjugated form is imperative,reads the corresponding seventh weight value from the weight value tablememory 115.

In addition, in the case where the pitch frequency of speech informationis greater than or equal to a certain threshold, the weight valuecalculator 116 reads the corresponding eighth weight value from theweight value table memory 115. Specifically, the weight value calculator116 stores, for each speech, a pitch frequency extracted by the pitchextractor 118 from input speech information and speaker informationrecognized by the speaker recognizer 120 are stored as a pair in thepitch memory 119. In response to a new speech input, a pitch frequencyextracted by the pitch extractor 118 from the input speech informationand speaker information recognized by the speaker recognizer 120 arestored as a pair in the pitch memory 119. At the same time, the pitchfrequency of the previous speech of the same speaker is compared withthe pitch frequency of this speech, and, in the case where the pitchfrequency of this speech is higher exceeding a preset threshold, thecorresponding eighth weight value is read from the weight value tablememory 115. Alternatively, instead of using speaker recognition by thespeaker recognizer 120, the eighth weight value may be read by using afixed threshold, regardless of the speaker.

In addition, the weight value calculator 116 adds the read weightvalues.

Note that, in the case where it is determined that the sentence patternof character information is not interrogative or imperative, a silenttime from when obtaining of speech information is completed to whenobtaining of the next speech information is started is not greater thanor equal to a certain time, a pre-stored keyword is not included in thecharacter information, a pre-stored personal name or nickname is notincluded in the character information, or the conjugated form of adeclinable word or phrase included in the character information is notimperative, the weight value calculator 116 does not add the weightvalues.

The recognition result determiner 117 determines whether the sum of theweight value added by the weight value calculator 116 is greater than orequal to a certain value, and, in the case where the sum weight value isgreater than or equal to the certain value, determines that the speechis spoken to the device 1.

Note that it is preferable that the first weight value, the secondweight value, the third weight value, the sixth weight value, and theseventh weight value be higher than the fourth weight value and thefifth weight value. The first weight value, the second weight value, thethird weight value, the sixth weight value, and the seventh weight valueare “5”, for example, the fourth weight value is “−5”, for example, andthe fifth weight value is “0”, for example. In the case where the sumweight value is greater than or equal to “10”, for example, therecognition result determiner 117 determines that the speech is spokento the device 1.

Note that the first to seventh weight values are not restricted to theabove values and may be other values. In addition, the certain valuewith which the sum weight value is compared is not restricted to theabove value and may be another value. In addition, the weight valuecalculator 116 may use some of the first to seventh weight values,instead of using all of the first to seventh weight values, to calculatea weight value for the recognition result determiner 117 to determinewhether the speech is spoken to the device 1.

In addition, in the weight value table, the determination result thatthe sentence pattern of character information is not interrogative orimperative may be associated with a certain weight value. In addition,in the weight value table, the determination result that a silent timefrom when obtaining of speech information is completed to when obtainingof the next speech information is started is not greater than or equalto a certain time may be associated with a certain weight value. Inaddition, in the weight value table, the determination result that apre-stored keyword is not included in character information may beassociated with a certain weight value. In addition, in the weight valuetable, the determination result that a pre-stored personal name ornickname is not included in character information may be associated witha certain weight value. In addition, in the weight value table, thedetermination result that the conjugated form of a declinable word orphrase included in character information is not imperative may beassociated with a certain weight value.

In addition, in the weight value table, the determination result thatspeech information is obtained after a silent time lasts for a certaintime or longer and a silent time lasts for the certain time or longerafter obtaining of the speech information is completed may be associatedwith a certain weight value.

According to the above configuration, in the case where weight valuesgiven in accordance with certain determination results for characterinformation are added and the sum weight value is greater than or equalto a certain value, it is determined that the speech is spoken to thedevice. Thus, the user can speak without paying attention to a specifickeyword that serves as a trigger for starting speech recognition, andthe user can operate the device using daily conversation.

Note that, in calculation of the fifth weight value, in order todetermine from a conversation between two or more people whether thespeech is spoken to the device, the condition that whether a time fromthe end of the previous speech to the start of this speech is less thanor equal to a preset time threshold may be set.

Note that, in the first to seventh embodiments, it is preferable thatthe device 1 include an information terminal such as a smart phone, atablet computer, or a mobile phone. In this case, the operationinstruction includes the operation instruction to obtain weatherforecast for a day specified by a user and output the obtained weatherforecast. For example, when the speech obtainer 101 obtains the speechinformation “Ashitano tenkiwo oshiete (Tell me the weather fortomorrow)”, the operation instruction generator 104 generates theoperation instruction to obtain the weather forecast for the next day.The operation instruction generator 104 outputs the generated operationinstruction to the mobile terminal.

In addition, in the first to seventh embodiments, it is preferable thatthe device 1 include a lighting device. In this case, the operationinstruction includes the operation instruction to turn on the lightingdevice and the operation instruction to turn off the lighting device.For example, when the speech obtainer 101 obtains the speech information“Denkiwo tsukete (Turn on the lighting device)”, the operationinstruction generator 104 generates the operation instruction to turn onthe lighting device. The operation instruction generator 104 outputs thegenerated operation instruction to the lighting device.

In addition, in the first to seventh embodiments, it is preferable thatthe device 1 include a faucet device that automatically turns on waterfrom an outlet. In this case, the operation instruction includes theoperation instruction to turn on water from the faucet device, and theoperation instruction to turn off water coming from the faucet device.For example, when the speech obtainer 101 obtains the speech information“Mizuwo 400 cc dashiete (Turn on 400 cc of water)”, the operationinstruction generator 104 generates the operation instruction to turn on400 cc of water from the faucet device. The operation instructiongenerator 104 outputs the generated operation instruction to the faucetdevice.

In addition, in the first to seventh embodiments, it is preferable thatthe device 1 include a television. In this case, the operationinstruction includes the operation instruction to change the channel ofthe television. For example, when the speech obtainer 101 obtains thespeech information “4 channel ni kaete (Change the channel to 4)”, theoperation instruction generator 104 generates the operation instructionto change the channel of the television to 4. The operation instructiongenerator 104 outputs the generated operation instruction to thetelevision.

In addition, in the first to seventh embodiments, it is preferable thatthe device 1 include an air conditioner. In this case, the operationinstruction includes the operation instruction to start the operation ofthe air conditioner, the operation instruction to stop the operation ofthe air conditioner, and the operation instruction to change the presettemperature of the air conditioner. For example, when the speechobtainer 101 obtains the speech information “Kuchono ondowo agete (Raisethe temperature of the air conditioner)”, the operation instructiongenerator 104 generates the operation instruction to raise the presettemperature of the air conditioner. The operation instruction generator104 outputs the generated operation instruction to the air conditioner.

Note that the above-described specific embodiments mainly include thedisclosure with the following configuration.

A speech recognition method according to an aspect of the presentdisclosure includes: a speech information obtaining step of obtainingspeech information representing speech spoken by a user; a speechrecognition step of recognizing the speech information, obtained in thespeech information obtaining step, as character information; and aspeaking determination step of determining whether the speech is spokento a device, on the basis of the character information recognized in thespeech recognition step.

According to this configuration, speech information representing speechspoken by a user is obtained. The obtained speech information isrecognized as character information. On the basis of the recognizedcharacter information, it is determined whether the speech is spoken toa device.

Therefore, since whether the speech is spoken to a device is determinedon the basis of the recognized character information, speaking of aspecific keyword that serves as a trigger for starting speechrecognition becomes unnecessary. Therefore, the user can speak withoutpaying attention to a specific keyword that serves as a trigger forstarting speech recognition, and the user can operate the device usingdaily conversation.

In addition, it is preferable that the above-described speechrecognition method further include an operation instruction generationstep of generating, in the case where it is determined in the speakingdetermination step that the speech is spoken to the device, an operationinstruction for the device.

According to this configuration, in the case where it is determined thatthe speech is spoken to the device, an operation instruction for thedevice is generated. Therefore, in the case where it is determined thatthe speech is spoken to the device, an operation instruction for thedevice is generated; and, in the case where it is determined that thespeech is not spoken to the device, no operation instruction for thedevice is generated. Thus, speaking a specific keyword that serves as atrigger for starting speech recognition becomes unnecessary.

In addition, in the above-described speech recognition method, it ispreferable that the speaking determination step analyze the sentencepattern of the character information, determine whether the sentencepattern is interrogative or imperative, and, in the case where thesentence pattern is interrogative or imperative, determine that thespeech is spoken to the device.

According to this configuration, the sentence pattern of characterinformation is analyzed, whether the sentence pattern is interrogativeor imperative is determined, and, in the case where the sentence patternis interrogative or imperative, it is determined that the speech isspoken to the device.

In the case where the sentence pattern is interrogative or imperative,it is highly likely that the speech is spoken to the device. Therefore,the fact that the speech is spoken to the device can be easilydetermined by determining whether the sentence pattern is interrogativeor imperative.

In addition, it is preferable that the above-described speechrecognition method further include a time measurement step of measuring,as a silent time, a time since obtaining of the speech information iscompleted, and a time determination step of determining, in the casewhere the speech information is obtained, whether the silent timemeasured in the time measurement step is greater than or equal to acertain time. It is preferable that the speaking determination stepdetermine that the speech is spoken to the device in the case where itis determined that the silent time, which is measured, is greater thanor equal to the certain time.

According to this configuration, a time since obtaining of speechinformation is completed is measured as a silent time, and, in the casewhere speech information is obtained, it is determined whether themeasured silent time is greater than or equal to a certain time. In thecase where it is determined that the measured silent time is greaterthan or equal to the certain time, it is determined that the speech isspoken to the device.

In the case where speech information is obtained after a silent time inwhich no speech information is obtained lasts for the certain time, itis highly likely that the speech is spoken to the device. Therefore, thefact that the speech is spoken to the device can be easily determined bydetermining whether a silent time from when obtaining of speechinformation is completed to when the next speech information is obtainedis greater than or equal to a certain time.

In addition, it is preferable that the above-described speechrecognition method further include a keyword storage step of storing inadvance a certain keyword regarding an operation of the device. It ispreferable that the speaking determination step determine whether thekeyword, which is stored in advance, is included in the characterinformation, and, in the case where the keyword is included in thecharacter information, determine that the speech is spoken to thedevice.

According to this configuration, a certain keyword regarding theoperation of the device is stored in advance. It is determined whetherthe pre-stored keyword is included in character information, and, in thecase where the keyword is included in the character information, it isdetermined that the speech is spoken to the device.

Therefore, the fact that the speech is spoken to the device can beeasily determined by storing in advance a certain keyword regarding theoperation of the device, and determining whether the keyword is includedin character information.

In addition, it is preferable that the above-described speechrecognition method further include a personal name storage step ofstoring in advance a personal name. It is preferable that the speakingdetermination step determine whether the personal name, which is storedin advance, is included in the character information, and, in the casewhere the personal name is included in the character information,determine that the speech is not spoken to the device.

According to this configuration, a personal name is stored in advance.It is determined whether the pre-stored personal name is included incharacter information, and, in the case where the personal name isincluded in the character information, it is determined that the speechis not spoken to the device.

In the case where the personal name is included in the characterinformation, it is highly likely that the speech is not spoken to thedevice, but is spoken to a person with the personal name. Therefore, thefact that the speech is spoken to the device can be easily determined bystoring in advance a personal name, and determining whether the personalname is included in character information.

In addition, it is preferable that the above-described speechrecognition method further include a detection step of detecting aperson in a space where the device is located. It is preferable that thespeaking determination step determine that the speech is not spoken tothe device in response to detection of a plurality of people in thedetection step, and determine that the speech is spoken to the device inresponse to detection of one person in the detection step.

According to this configuration, a person in a space where the device islocated is detected. In response to detection of a plurality of people,it is determined that the speech is not spoken to the device; and, inresponse to detection of one person, it is determined that the speech isspoken to the device.

In the case where there is a plurality of people in a space where thedevice is located, it is highly likely that the user's speech is spokento another person. In addition, in the case where there is only oneperson in a space where the device is located, it is highly likely thatthe user′ speech is spoken to the device. Therefore, the fact that thespeech is spoken to the device can be easily determined by detecting thenumber of people in a space where the device is located.

In addition, in the above-described speech recognition method, it ispreferable that the speaking determination step determine whether theconjugated form of a declinable word or phrase included in the characterinformation is imperative, and, in the case where the conjugated form isimperative, determine that the speech is spoken to the device.

According to this configuration, it is determined whether the conjugatedform of a declinable word or phrase included in character information isimperative, and, in the case where the conjugated form is imperative, itis determined that the speech is spoken to the device.

In the case where the conjugated form of a declinable word or phraseincluded in character information is imperative, it is highly likelythat the speech is spoken to the device. Therefore, the fact that thespeech is spoken to the device can be easily determined by determiningwhether the conjugated form of a declinable word or phrase included incharacter information is imperative.

In addition, it is preferable that the above-described speechrecognition method further include a weight value calculation step ofadding weight values given in accordance with certain determinationresults for the character information. It is preferable that thespeaking determination step determine whether a sum of the weight valuesadded in the weight value calculation step is greater than or equal to acertain value, and, in the case where the sum of the weight values isgreater than or equal to the certain value, determine that the speech isspoken to the device.

According to this configuration, weight values given in accordance withcertain determination results for character information are added. It isdetermined whether the sum weight value is greater than or equal to acertain value, and, in the case where the sum weight value is greaterthan or equal to the certain value, it is determined that the speech isspoken to the device.

Therefore, weight values given in accordance with certain determinationresults for character information are added, and it is determined inaccordance with the sum weight value whether the speech is spoken to thedevice. Thus, the fact that the speech is spoken to the device can beaccurately determined by changing the values of the weight values inaccordance with certain determination results for character information.

In addition, in the above-described speech recognition method, it ispreferable that the weight value calculation step add the following: aweight value given in accordance with whether the sentence pattern ofthe character information is interrogative or imperative; a weight valuegiven in accordance with whether a silent time, which is a measured timesince obtaining of the speech information is completed, is greater thanor equal to a certain time, in response to obtaining of the speechinformation; a weight value given in accordance with whether apre-stored certain keyword regarding the operation of the device isincluded in the character information; a weight value given inaccordance with whether a pre-stored personal name is included in thecharacter information; a weight value given in accordance with whether aplurality of people is detected in a space where the device is located;and a weight value given in accordance with whether the conjugated formof a declinable word or phrase included in the character information isimperative.

According to this configuration, the following are added: a weight valuegiven in accordance with whether the sentence pattern of characterinformation is interrogative or imperative; a weight value given inaccordance with whether a silent time from when obtaining of speechinformation is completed to when obtaining of the next speechinformation is started is greater than or equal to a certain time; aweight value given in accordance with whether a pre-stored certainkeyword regarding the operation of the device is included in thecharacter information; a weight value given in accordance with whether apre-stored personal name is included in the character information; aweight value given in accordance with whether a plurality of people isdetected in a space where the device is located; and a weight valuegiven in accordance with whether the conjugated form of a declinableword or phrase included in the character information is imperative.

Therefore, these weight values weight values are added, and whether thespeech is spoken to the device is determined in accordance with the sumweight value. Therefore, the fact that the speech is spoken to thedevice can be more accurately determined.

In addition, in the above-described speech recognition method, it ispreferable that the device include a mobile terminal, the operationinstruction include the operation instruction to obtain weather forecastfor a day specified by the user and to output the obtained weatherforecast, and the operation instruction generation step output thegenerated operation instruction to the mobile terminal.

According to this configuration, the weather forecast for a dayspecified by the user can be obtained, and the obtained weather forecastcan be output from the mobile terminal.

In addition, in the above-described speech recognition method, it ispreferable that the device include a lighting device, the operationinstruction include the operation instruction to turn on the lightingdevice and the operation instruction to turn off the lighting device,and the operation instruction generation step output the generatedoperation instruction to the lighting device.

According to this configuration, the lighting device can be turned on orthe lighting device can be turned off using speech.

In addition, in the above-described speech recognition method, it ispreferable that the device include a faucet device that automaticallyturns on water from an outlet, the operation instruction include theoperation instruction to turn on water from the faucet device, and theoperation instruction to turn off water coming from the faucet device,and the operation instruction generation step output the generatedoperation instruction to the faucet device.

According to this configuration, water can be turned on from the faucetdevice or water coming out from the faucet device can be turned offusing speech.

In addition, in the above-described speech recognition method, it ispreferable that the device include a television, the operationinstruction include the operation instruction to change the channel ofthe television, and the operation instruction generation step output thegenerated operation instruction to the television.

According to this configuration, the channel of the television can bechanged using speech.

A speech recognition apparatus according to another aspect of thepresent disclosure includes a speech information obtainer that obtainsspeech information representing speech spoken by a user; a speechrecognizer that recognizes the speech information, obtained by thespeech information obtainer, as character information; and a determinerthat determines, based on the character information recognized by thespeech recognizer, whether the speech is spoken to a device.

According to this configuration, speech information representing speechspoken by a user is obtained. The obtained speech information isrecognized as character information. On the basis of the recognizedcharacter information, it is determined whether the speech is spoken toa device.

Therefore, since whether the speech is spoken to a device is determinedon the basis of the recognized character information, speaking of aspecific keyword that serves as a trigger for starting speechrecognition becomes unnecessary. Therefore, the user can speak withoutpaying attention to a specific keyword that serves as a trigger forstarting speech recognition, and the user can operate the device usingdaily conversation.

Note that specific embodiments or examples discussed in the section ofthe embodiments for making the disclosure are only intended to clarifythe technical contents of the present disclosure and should not benarrowly interpreted to limit the present disclosure to such specificexamples. Various modifications are permissible within the spirit of thepresent disclosure and the scope of the following claims.

INDUSTRIAL APPLICABILITY

A speech recognition method and a speech recognition apparatus accordingto the present disclosure can dispense with speaking of a specifickeyword for starting speech recognition and are effective as a speechrecognition method and a speech recognition apparatus that recognizeinput speech and control a device on the basis of the recognitionresult.

REFERENCE SIGNS LIST

1 device

11 communicator

12 controller

13 memory

14 microphone

15 loudspeaker

16 display

100 speech recognition apparatus

101 speech obtainer

102 speech recognition processor

103 recognition result determiner

104 operation instruction generator

What is claimed is:
 1. A speech recognition method in a system thatcontrols a plurality of devices by using speech recognition, comprising:obtaining speech information representing speech spoken by a user;determining whether the speech information identifies one device of theplurality of devices, based on content of the speech information;generating, in a case where it is determined that the content of thespeech information identifies the one device, an operation instructionfor the identified one device; determining whether the speech is spokento the identified one device by analyzing a sentence pattern of thespeech information, which includes determining whether the sentencepattern is interrogative, determining whether the sentence pattern isimperative, determining whether the sentence pattern is declarative,determining whether the sentence pattern is exclamatory, determining, ina case where the sentence pattern is interrogative or imperative, thatthe speech is spoken to the identified one device, and determining, in acase where the sentence pattern is declarative or exclamatory, that thespeech is not spoken to the identified one device, wherein the operationinstruction is executed by the identified one device when the speech isdetermined to be spoken to the identified one device based on thedetermined content and sentence pattern.
 2. A speech recognitionapparatus that controls a plurality of devices by using speechrecognition, comprising: one or more memories; and circuitry thatperforms operations, including obtaining speech information representingspeech spoken by a user; determining, whether the speech informationidentifies one device of the plurality of devices, based on content ofthe speech information; generating, in a case where it is determinedthat the content of the speech information identifies the one device, anoperation instruction for the identified one device, determining whetherthe speech is spoken to the identified one device by analyzing asentence pattern of the speech information, which includes determiningwhether the sentence pattern is interrogative, determining whether thesentence pattern is imperative, determining whether the sentence patternis declarative, determining whether the sentence pattern is exclamatory,determining, in a case where the sentence pattern is interrogative orimperative, that the speech is spoken to the identified one device, anddetermining, in a case where the sentence pattern is declarative orexclamatory, that the speech is not spoken to the identified one device,wherein the operation instruction is executed by the identified onedevice when the speech is determined to be spoken to the identified onedevice based on the determined content and sentence pattern.